Attempt to distinguish the origins of self-similarity by natural time analysis. 
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Self-similarity may originate from two origins, i.e., the process memory and the process' increments 
"infinite" variance. A distinction is attempted by employing the natural time %■ Concerning the 
first origin, we analyze recent data on Seismic Electric Signals, which support the view that they 
exhibit infinitely ranged temporal correlations. Concerning the second, slowly driven systems that 
emit bursts of various energies E obeying power-law distribution, i.e., P(E) ~ E" 1 ,are studied. An 
interrelation between the exponent 7 and the variance ki(= (\ 2 ) — (x) 2 ) i s obtained for the shuffled 
(randomized) data. In the latter, the most probable value of k\ is approximately equal to that of the 
original data. Finally, it is found that the differential entropy associated with the probability P(ki) 
maximizes for 7 around 7 « 1.6 to 1.7, which is comparable to the value determined experimentally 
in diverse phenomena, e.g., solar flares, icequakes, dislocation glide in stressed single crystals of ice 
e.t.c. It also agrees with the b-value in the Gutenberg-Richter law of earthquakes. 
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PACS numbers: 05.40.-a, 91.30.Dk, 05.45. Tp, 89.75.-k 

I. INTRODUCTION 

A large variety of natural systems exhibit irregular and 
complex behavior which at first looks erratic, but in fact 
possesses scale invariant structure (e.g., 0,0)- A process 
{X(t)} t > is called self-similar Q if for some H > 0, 



X(at) = a H X{t) V a > 0, 



(1) 



where the symbol of equality refers here to all finite- 
dimensional distributions of the process on the left and 
the right, and the parameter H is called self-similarity in- 
dex or exponent. Equation Q means a "scale invariance" 
of the finite-dimensional distributions of X(t), which does 
not imply, in stochastic processes, the same for the sam- 
ple paths (e.g., 0|). Examples of self-similar processes 
are Brownian, fractional Brownian (fBm), Levy stable 
and fractional Levy stable motion (fLsm). Levy stable 
distributions (which are followed by many natural pro- 
cesses, e.g., 0@) differ greatly from the Gaussian ones 
because they have heavy tails and their variance is infi- 
nite (e.g., 0,0). 

An important point in analyzing data from natural sys- 
tems that exhibit scale invariant structure, is the follow- 
ing: In several systems this nontrivial structure points to 
long-range temporal correlations; in other words, the self- 
similarity results from the process' memory only (e.g., the 
case of fBm) . Alternatively, the self-similarity may solely 
result from the process' increments infinite variance, e.g., 
Levy stable motion. (Note, that in distributions that are 
applicable to a large variety of problems, extreme events 
have to be truncated for physical reasons, e.g., finite size 



effects, -when there is no infinity and this is why we 
write hereafter "infinite".) In general, however, the self- 
similarity may result from both these origins (e.g., fLsm). 
It is the main aim of this paper to discuss how a dis- 
tinction of the two origins of self-similarity (i.e., process' 
memory, process' increments "infinite" variance) can be 
in principle achieved by employing the natural time anal- 
ysis. 

In a time series comprising TV events, the natural time 
Xk = k/N serves as an index0, for the occurrence 
of the fc-th event. The evolution of t he p air (\ k ,Q k) 

is considered!! E3, EH E3, EE E3, EE EE E3, Ea 

where Qk denotes in general a quantity proportional to 
the energy released in the fc-th event. For example, for 
dichotomous signals Qk stands for the duration of the k- 
th pulse while for the seismicity Qk is proportional to the 
seismic energy released during the fc-th earthquake [30, 
Il9l | (which is proportional to the seismic moment Mn). 
The normalized power spectrum H(cu) was introduced^ 
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where pk = Qk/ ^2n=iQ n an< ^ w = 2tt0; 4> stands for 
the natural frequency. When the system enters into the 
critical stage, the following relation holds plUof: 
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For to -> 0, Eq.jp leads to[!ElE3 n H ~ 1 " °- 07uj2 
which reflects [l2| that the variance of x is given by 
«i = (X 2 ) - (X) 2 =£07, where (/(*)) = Ek=iPk.f(Xk). 
It has been arguedE3 that in the case of earthquakes, 
H(4>) for <f> — y 0, can be considered as an order param- 
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eter and the corresponding probability density distribu- 
tion function (PDF) is designated by P[II(</>)]. Since, at 
4> — > 0, ki is linearly related to 11(0) (because Eq.JSJ) 
leads to 11(0) = 1 — Ah 2 4> 2 k,i for 0—^0) one can study, 
instead of P[Tl(4>)], the PDF of « X) i.e., P(ki). This will 
be used here. The entropy S in the natural time-domain 
is defined asjjj^] S = (x m x) — ixl ln(y) , which depends 
on the sequential order of events [jjjlij] and for infinitely 
ranged temporal correlations its value is smaller 0, Hq 
than the value S u (= 1/2 In 2 - 1/4 w 0.0966)of a "uni- 
form" distribution (defined in Refs. HEllllElEI, 
e.g. when all pk are equal), i.e. ,S < S u . The value of the 
entropy obtained|l5l| upon considering the time reversal 
T, i.e., Tpk — PN-k+i, is labelled by S-. 

This paper is organized as follows: In Section II, we 
treat the case when the self-similarity solely results from 
the process' memory. Section III deals with the self- 
similarity resulting from the process' increments infinite 
variance by restricting ourselves to slowly driven systems 
that emit energy bursts obeying power law distributions. 
A brief discussion follows in Section IV, while Section V 
presents the main conclusion. 



II. THE CASE OF TEMPORAL 
CORRELATIONS 

We consider, as an example, Seismic Electric Signals 
(SES) activities which exhibit infinitely ranged temporal 
correlations [13 El El • 

Figure H[a) shows a recent SES 
activity recorded at a station located in central Greece 
(close to Patras city, PAT) on February 13, 2006. It 
comprises 37 pulses, the durations of which vary be- 
tween Is and 40s (see Fig. Gib)). The natural time rep- 
resentation of this SES activity can be seen in FigGIb) 
and the computation of Ki, S and SL leads to the fol- 
lowing values: m = 0.072 ± 0.002, S = 0.080 ± 0.002, 
S_ = 0.078 ± 0.002. These values obey the condi- 
tions Ki « 0.070 and S, S- < S u that have already 
been found^, 0> E3 to be obeyed for other SES ac- 
tivities. If we repeat the computation for surrogate 
data obtained by shuffling the durations Q K randomly 
(and hence their distribution is conserved), the corre- 
sponding quantities, designated by adding a subscript 
"shuf", have the following values: Ki, s /cu/ = 0.082 and 
S s huf{= S- >s huf) = 0.091 with standard deviations 0.008 
and 0.011 respectively. They are almost equal to the 
corresponding values of a "uniform" distribution, i.e., 
K u = 0.0833 and S u = 0.0966, although the experimen- 
tal error in this case is large due to the small number 
of pulses. By applying the same procedure to other SES 
activities reported earlier EU, we find (see Table that 
actually Ki. shu f w k u and S shu f ~ S-,shuf ~ S u . This 
points to the conclusion that the self-similarity of SES 
activity results from the process' memory only, which 
agrees with an independent analysis of Ref . 3 . 

In addition, the Detrended Fluctuation Analysis 
fDFAl[20l En] in natural time of the SES activity de- 
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FIG. 1: (a) An SES activity recently recorded at PAT sta- 
tion(sampling rate f exp — 1Hz). The actual electric field E 
is 6 mV/km, but here the signal is presented in normalized 
units, i.e., by subtracting the mean value jj, and dividing by 
the standard deviation a. (b) How the SES activity in (a) is 
read in natural time. 

picted in Fig^ leads to an exponent olbfa — 1.07±0.36, 
which agrees with the earlier finding a d fa ~ 1 in several 
other SES activities EH- Interestingly, the values of the 
quantities K%, S, S- and o>dfa are consistent with the re- 
sults deduced from a numerical simulation in fBm time 
series described in Ref. EH; the latter showed that when 
otDFA ~ 1 the corresponding values are: K\ ~ 0.070, 
S ~ S- ~ 0.080. Figure depicts the most probable 
value Ki tP of K\ versus oidfa resulting from such a nu- 
merical simulation. 



III. THE CASE OF POWER LAW 
DISTRIBUTIONS 

We now study a case of self-similarity resulting from 
the process' increments "infinite" variance. Here, we re- 
strict ourselves to slowly driven systems that emit energy 
bursts obeying power law distribution 

P(E) - £T 7 (4) 

where 7 is constant. In a large variety of such systems, 
in diverse fields, an inspection of the recent experimental 
data reveals that the 7 exponent lies in a narrow range, 
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TABLE I: The values of Ki, Ki :S huf, S, S- and S 3 huf for the SES activities mentioned in Ref. 1 1511 as well as the one (PAT) 
depicted in FigQ The numbers in parentheses denote the standard deviation for the distributions of Ki t ,huf and S 3 huf in the 
shuffled data. 



Signal 




Kl,shuf 


S 




Q b 

^shuf 


Kl 


0.063±0.003" 


0.083(0.005) 


0.067±0.003° 


0.074±0.003 a 


0.096(0.007) 


K2 


0.078±0.004" 


0.082(0.007) 


0.081±0.003 a 


0.103±0.003" 


0.094(0.009) 


A 


0.068±0.004" 


0.082(0.007) 


0.070±0.008 a 


0.084±0.008 a 


0.092(0.010) 


U 


0.071±0.004° 


0.082(0.009) 


0.092±0.004 a 


0.071±0.004 a 


0.093(0.012) 


Ti 


0.084±0.007° 


0.082(0.007) 


0.088±0.007 a 


0.098±0.010 a 


0.091(0.010) 


CI 


0.074±0.002 a 


0.082(0.008) 


0.083±0.004 a 


0.080±0.004 a 


0.092(0.011) 


PI 


0.075±0.004 a 


0.082(0.008) 


0.087±0.004° 


0.081±0.004° 


0.090(0.011) 


P2 


0.071±0.005 a 


0.082(0.009) 


0.088±0.003 a 


0.072±0.015° 


0.091(0.012) 


El 


0.077±0.017° 


0.083(0.008) 


0.087±0.007 a 


0.081±0.007 a 


0.092(0.010) 


PAT 


0.072±0.002 


0.082(0.008) 


0.080±0.002 


0.078±0.002 


0.091(0.011) 


"from Ref. HI 
'note that S^^/ 


= S , _ jS hu/ as mentioned 


in the text. 









TABLE II: Compilation of the experimental values of the power-law exponent 7 determined in different processes. 



Process / type of measurement 



References 



Dislocation glide in hexagonal 
ice single crystals (Acoustic emission) 

Solar flares 

Microfractures before the 
breakup of wood (acoustic emission) 

Microfractures before the 
breakup of fiberglass (acoustic emission) 

Earthquakes 



Icequakes 



1.5 - 2.1 
1.51 

2.0 

1.5 - 1.8 (6 = 0.8 to 1.2) 
~1.8 (6 « 1.25) 



[23J 

[24, 33, 34, 35] 
[36,37] 

[36,37] 



See Ref. [27] 
and references therein 

See p.212 of [38] 
and references therein 
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FIG. 2: (Color online) The values of function of 

(Xdfa for the case of the fBm simulations of Ref.|l8| (crosses, 
lower scale) or as a function of 7 for power law distributed 
data (asterisks, upper scale). They have been estimated 
by following the procedure described in the Appendix B of 
Ref . [l7)l . The corresponding lines have been drawn as a guide 
to the eye. 



i.e., 1.5 < 7 < 2.1 (and mostly even within narrower 
bounds, i.e., 7 = 1.5 to 1.8). To realize the diversity of 
the phenomena that exhibit the aforementioned property, 
we compile some indicative examples in Table [H] which 
are the following. 

First, crystalline materials subjected to an external 
stress, display bursts of activity owing the nucleation and 
motion of dislocations. These sudden local changes pro- 
duce acoustic emission waves which reveal that a large 
number of dislocations move cooperatively in an inter- 
mittent fashion (e.g., see and references therein). As 
a precise example, we include in Table [n] the results of 
acoustic emission experiments on stressed single crystals 
of ice under viscoelastic deformation (creep), which show 
that the probability distribution of energy bursts intensi- 
ties obey a power-law distribution with 7 = 1.6 spanning 
many decades (see FigQ]of |23|). Second, we consider 
the case of solar flares that represent im puls ive energy 
releases in the solar corona (e.g . see Ref. |24| and refer- 
ences therein; see also Ref. [25j in which it is concluded 
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FIG. 3: (Color online) The probability density function -P(ki) 
versus Ki for several values of 7 (see the text and |2^|). 
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FIG. 4: (Color online)The PDFs of K\ when using either the 
actual seismic catalogue of Japan(solid) treated in Ref.p^| or 
the same data in random order (dashed) . 
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FIG. 5: (Color online) The calculated values of the differen- 
tial entropy Si versus the exponent 7. Two window lenghts 
are used and their results are almost the same. 



that earthquakes and solar flares exhibit the same dis- 
tributions of sizes, interoccurrence times, and the same 
temporal clustering). This energy release is observed in 
various forms: thermal, soft and hard x-ray emissions, 
accelerated particles etc. The statistical analysis of these 
impulsive events show that the energy distribution ex- 
hibit, over several orders of magnitude, a power-law with 
exponents 7 ranging from 1.5 to approximately 2.1 (de- 
pending on the experimental procedure and the geomet- 
rical assumptions adopted in the analysis). Other exam- 
ples are: acoustic emission from microfractures before the 
breakup of heterogeneous materials (wood, fiberglass), 
icequakes and earthquakes. 

Concerning the latter, the best known scaling rela- 
tion is the Gutenberg- Richter law 26j , which states that 
the (cumulative) number of earthquakes with magnitude 
greater than m occurring in a specified area and time is 
given by 



N{> m) ~ 10 



-brn 



(5) 



where b is a constant, which varies only slightly from 
region to region (cf. Eq.JSJ) holds both regionally and 
globally) being generally in the range 0.8 < b < 1.2 (see 
|27| and references therein). Considering that the seismic 
energy E released during an earthquake is related 28] to 
the magnitude through E ~ 10 cm -where c is around 1.5- 
Eq.(J5} turns to Eq.Q, where 7 = 1 + 6/1.5. Hence, b w 1 
means that the exponent 7 is around 7=1.6 to 1.7. 

The following procedure is now applied: We gener- 
ate(see also 29] ) a large amount of artificial data obey- 
ing Eq.© for a certain 7 value. These randomized 
("shuffled" 13|) data are subsequently analyzed, in the 
natural time domain, for each 7 value, with the follow- 
ing procedure \v?\: First, calculation of the variance ni 
is made for an event taking time windows for 6 to 40 
consecutive events (the choice of the precise value of the 
upper limit is not found decisive, because practically the 
same results are obtained even if the number of consec- 
utive events was changed from 6 - 40 to 6 - 100, as it 
will be further discussed below). And second, this pro- 
cess was performed for all the events by scanning the 
whole dataset. In Fig|31we plot the quantity P (ki) ver- 
sus Ki for several 7-values. The most probable value 
(for 7 =constant) is also plotted in Fig|3versus the corre- 
sponding 7-value. This curve interrelates k\ and 7 for the 
shuffled data (thus an eventual process' memory is here 
destroyed [l3j) and hence the plotted K\# values (which 
differ markedly from n u ) correspond to the self-similarity 
resulting from the heavy-tailed distribution only. 

In order to identify the origin of self-similarity in a real 
data set, let us consider here the example of earthquakes. 
Using the Japan catalogue mentioned in Ref. i we gi ye 
in Fig. 4 the two curves P(ki) versus K\ that result when 
the aforementioned calculation is made by means of a 
window of 6-40 concecutive events sliding through cither 
the original catalogue or a shuffled one. Comparing the 
resulting K\ iV values (both of which markedly differ from 
k u ) we see that the value of the surrogate data (« 0.064) 
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differs slightly from the one (~ 0.066) corresponding to 
the original data. This reflects that the self-similarity 
mainly originates from the process' increments "infinite" 
variance. Note, however, that the value of the orig- 
inal data is comparable to the value ki=0.070 that was 
found in infinitely ranged temporal correlations. This 
merits further investigation. 

IV. DISCUSSION 

Here, we discuss a challenging point that emerges from 
a further elaboration of the results depicted in Fig. 3. 
First, note that upon increasing the 7 value from 7 = 
1.3 to 2.0, the feature of the curve changes significantly, 
becoming bimodal at intermediate 7-values. Second, we 
calculate, for each 7-value studied, the so called differ- 
ential entropy, defined as Si = — J P{ki) In P(ni)dni 
which is the Shannon information entropy of a continu- 
ous probability distribution, e.g., see [3(|. (Note that, the 
Shannon information entropy is static entropy and not a 
dynamic one [13J.) Finally, we investigate the resulting 
S7-values versus 7. Such a plot is given in Fig. 5, whose 
inspection reveals that Si maximizes at a value of 7 lying 
between 7 = 1.6 and 7=1.7, which is more or less com- 
parable with the experimental values, see Table ITU (This 
value is not practically affected by the window length (I) 
chosen; in reality, upon increasing I from 1=10 to Z=1000, 
we find that, 7-value at which Si maximizes in Fig[3 de- 
creases only slightly from 7=1.70 to 7=1.63.) In partic- 
ular for the case of earthquakes this 7-value corresponds 
to b w 1, thus agreeing with the experimental findings 
mentioned above. Does it mean that the 6 or 7 value 



can be determined just by applying the Maximum En- 
tropy Principle in the sense developed by Javnes |3lll3^| . 
who suggested to look statistical mechanics as a form of 
statistical inference and start statistical physics from the 
principle of maximum entropy inference (MaxEnt)? This 
is not yet clear, because a widely accepted formalism for 
non- equilibrium statistical mechanics is still lacking. 

Finally, the fact that in some experiments the result- 
ing 7-values differ slightly from 7=1.6 to 1.7 predicted 
from FigEl could be attributed to the following: FigureEl 
is based on randomized data, while the actual data may 
also exhibit temporal correlations (e.g., the case of after- 
shocks). In addition, finite size effect s@ might play a 
significant role. 



V. CONCLUSION 

In summary, the origin of self-similarity may be dis- 
tinguished as follows: If self-similarity exclusively results 
from the process' memory, the n\ value should change to 
re„=0.0833 (and the values of S, S- to S„=0.0966) for the 
surrogate data. On the other hand, if the self-similarity 
results from process' increments "infinite" variance only, 
the Ki.p values should be the same (but differing from 
k u ) for the original and surrogate data. 

When studying the differential entropy associated with 
the PDF of K\ it maximizes when the exponent 7 lies 
in the narrow range 1.6 to 1.7, in agreement with the 
experimental findings in diverse fields. This, for the case 
of earthquakes, immediately reflects that the 6-value in 
the Gutenberg-Richter law is b « 1, as actually observed. 
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